INFINITESIMAL RIGIDITY OF A COMPACT HYPERBOLIC 
4-ORBIFOLD WITH TOTALLY GEODESIC BOUNDARY 



TARIK AOUGAB AND PETER A. STORM 

Abstract. KerckhofT and Storm conjectured that compact hyperbolic n-orbifolds 
with totally geodesic boundary are infinitesimally rigid when n > 3. This pa- 
per verifies this conjecture for a specific example based on the 4-dimensional 
hyperbolic 120-cell. 



1. INTRODUCTION 

Given a discrete subgroup F of a semisimple Lie group G, mathematicians have 
long studied the question of when T can be deformed inside G. On one side he the 
great rigidity theorems of Calabi, Weil, Mostow, and Margulis, which roughly state 
that lattices in most semisimple Lie groups have no deformations. On the other side 
lie the beautiful deformations theories of discrete groups of 2 x 2 matrices, famous 
exceptions to the rigidity theorems. If G is a Lie group that is not represented 
by 2 X 2 matrices, and F is not a lattice, then nearly nothing is known about the 
possible deformations of F. Do reasonable geometric conditions exist that guarantee 
rigidity, or flexibility? 

As a first step in this direction, Kerckhoff and Storm studied deformations of a 
specific discrete subgroup of Isom(IHI*), the isometry group of hyperbolic 4-space 
[5]. This led them to the following rigidity conjecture. 

Conjecture 1.1. // discrete group F < /som(H") has Fuchsian ends, is convex 
cocompact, and n > 3, then the inclusion map of F is infinitesimally rigid. 

Qualitatively, groups F satisfying the hypotheses of Coni ect ure II . II are very close 
to lattices. Drop any of the three conditions on F, and the conjecture becomes false. 
For any n, there are many convex cocompact discrete groups in Isom(H") that are 
not rigid, for example if F is a free group. For n < 4 there exists a rich deformation 
theory applicable to discrete subgroups with Fuchsian ends. Even weakening the 
convex cocompact condition to geometric finiteness makes the conjecture false. A 
counterexample is presented in [5]. Nonetheless, it seems reasonable to expect 
Conjecture 11.11 to be true. 

Before trying to prove the full conjecture, it seems prudent first to verify it in 
a nontrivial case. This is our goal here. More specifically, we will construct an 
explicit reflection group in Isom(EII'*) satisfying the hypotheses of Conjecture 11.1) 
and verify that it is infinitesimally rigid. The reflection group will be an infinite 
index subgroup of the lattice generated by reflections in the 3-cells of the right- 
angled hyperbolic 120-cell in M*. This discrete group was chosen carefully to make 
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the computations as simple as possible. The group is described precisely in Sections 
El and H 

The authors thank Daniel AUcock for his help with this research. 

2. Preliminaries 

This section is a brisk introduction to a few necessary facts from hyperbolic 
geometry. For a detailed introduction see, for example, Ratcliffe's book [5]. 

Recall that Minkowski (n+l)-space, denoted as M"'+-'^ is a real (n+l)-dimensional 
vector space equipped with the nondegenerate symmetric bilinear form 

n 

{x, y) := -xoyo + ^ x^y^. 

i=l 

A vector with positive norm is a space-like vector, a vector of norm is light-like, 
and a vector with negative norm time-like. The hyperboloid model of hyperbolic 
n-space H" is simply the the set of points 

{x e M"+i I {x, x) = -1 and xq > 0} , 

with the metric induced by M"+^. Let 0(1, n) be the group of real (n-H 1) x 1) 
matrices A such that MA = M, where M is the (n + 1) x (n + 1) diagonal 
matrix with diagonal entries {—1, 1,1,..., 1}. In other words, 0(1, n) is the group of 
linear transformations preserving the bilinear form (•, •). Then the group Isom(]HI") 
of isometrics of H" is the open subgroup of 0(1, rt) given by matrices preserving 
the hyperboloid H". Note that orientation reversing isometrics are included here; 
Isom(H") has two connected components. Throughout the paper we will think of 
Isom(]HI") as this explicit group of matrices. To simplify notation, define Gn ■= 
Isom(M"). 

Consider a discrete finitely generated subgroup F of G„ with presentation 

r = (ri, r2, . . . , TAf I wi = W2 ^ ■ ■ ■ ^ WN ^ I) , 

where each Wi is a word in the generators rj. (The letter r stands for "reflection", 
which will soon be the focus.) To avoid degenerate cases, let us assume that F 
is not virtually abelian, and does not preserve a copy of H™ for m < n. If F is 
torsion-free, then the quotient H^/F will be a hyperbolic manifold. More generally, 
the quotient will be an orbifold. If the quotient space has finite volume then F 
is called a lattice. Here we will be mainly interested in infinite volume quotient 
spaces, where a little more terminology is required. 

Definition 2.1. The discrete group F has Fuchsian ends if there exists a closed F- 
invariant convex set Cr ^ H" that is an n-manifold with nonempty totally geodesic 
boundary, and such that the quotient Cr/F has finite volume. 

Note that the boundary of Cr will not be connected. In the setting of groups 
with Fuchsian ends, F is convex cocompact if and only if the quotient Cr/F is 
compact. 

If F has Fuchsian ends, then dCr consists of an infinite number of disjoint totally 
geodesic hyperplanes, each isometric to H"~^. When F is torsion- free, it has Fuch- 
sian ends if and only if the quotient Cr /F is a finite volume hyperbolic n-manifold 
with nonempty totally geodesic boundary. In general, Cr/F will be a finite volume 
orbifold with totally geodesic boundary. For the reader familiar with convex cores, 
we note that if F has Fuchsian ends then Cr is the convex core of F. 
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Consider the representation variety Hom(r, G„). The shghtly larger space Hom(r, 0(1, n)) 
can be represented exphcitly as the zero set of a collection of real polynomials as 
follows. A homomorphism p : T 0(1, n) is determined uniquely by the M ma- 
trices p{rj) of 0(1, n), which can be thought of as a point in a real vector space 
V of dimension M ■ (n + 1)^. The p{rj) must lie in 0(1, n), meaning for each j 
the {n + 1)^ polynomials p{rj)^Mp{rj) — M are satisfied. Each relation Wi of F 
becomes a system of (n + 1)^ polynomial equations in the entries of the matrices 
p{rj). The variety Hom(r, 0(1, n)) C is precisely the set of points where these 
[M + N) ■ (n + lY polynomial equations {Pa} are satisfied. Finally, we are in- 
terested in the subset Hom(r, G„) C Hom(r, 0(1, n)). It is the set of connected 
components where the upper-left matrix entry of each p{rj) is positive. (This entry 
cannot be zero for a matrix in 0(1,4).) 

The group G„ acts on Hom(r, G„) by conjugation as follows: 

(.9 • P){l) ■= 9p{l)9^^, 

where g G G„ and 7 e F. It is easy to see that this action is algebraic. The 
inclusion map T — s- G„ is a point t G IIom(r, G„). In general, analyzing the orbits 
of this G„-action can be complicated. However, using our assumptions that T is 
not virtually abelian and does not preserve a lower dimensional hyperbolic space, 
it is easy to show that the orbit G„ • l C Hom(r, G„) is a manifold of dimension 
equal to that of G„ [4] . 

A homomorphism p g Hom(r, G„) is locally rigid if it has an open neighborhood 
contained inside the orbit G„ • p, in other words all nearby representations are 
obtained by conjugation. The infinitesimal analogue of this notion is useful. An 
infinitesimal deformation of p is a tangent vector p'(0) € TpV to a smooth path 
p : (— £, e) such that 

|loPo(KO) = o 

for the (M -I- N) ■ {n + 1)^ polynomial equations defining Hom(r, 0(1, n)) (and 
locally defining Hom(r, G„)). This slightly odd definition is necessitated by the 
possibility that Hom(r, G„) is singular. Similarly, an infinitesimal conjugation of 
p is a tangent vector p'{0) € TpV to a smooth path p in the orbit G„ • p. We 
say p is infinitesimally rigid if every infinitesimal deformation is an infinitesimal 
conjugation. An infinitesimally rigid homomorphism is also locally rigid [3]. By the 
above discussion, to show that the inclusion map t of G„ is infinitesimally rigid, it 
suffices to show that the linear subspace of infinitesimal deformations has dimension 
equal to that of G„. 

When r < G„ is a lattice, we have the famous rigidity theorem of Calabi, Weil, 
and Garland. 

Theorem 2.2. [T1[H1[3] //F < /som(H") is a lattice and n > 3 then the inclusion 
map o/r is infinitesimally rigid. 

For discrete groups that are not lattices, Theorem l2.2l is false, but it is interesting 
to study whether or not a similar rigidity theorem might hold for any other natural 
class of discrete groups. Looking for infinite covolume groups which are as "close" 
to lattices as possible, Kerckhoff and Storm were led to consider discrete groups 
with Fuchsian ends. In H'^, groups with Fuchsian ends are not rigid, and have a 
beautiful deformation theory investigated by many people [7]. In higher dimensions, 
simple naive dimension counts suggest that groups with Fuchsian ends are rigid. 
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These dimension counts are, of course, not rigorous. Nonetheless, Kerckhoff and 
Storm were led to the following conjecture, stated first in the introduction. 

Conjecture II. li // discrete group T < Isom{M") has Fuchsian ends, is convex 
cocompact, and n> 3, then the inclusion map ofT is infinitesimally rigid. 

Note that Conjecture If .11 is false without the assumption that F is convex co- 
compact. A counterexample was studied in [5]. As a first step toward proving this 
conjecture, the goal of this paper is to verify it in a specific 4-dimensional example. 
In search of an example where the computations are as simple as possible, the first 
place to look is among hyperbolic reflection groups, which we now introduce briefly. 
For more information the authors recommend [8]. 

A reflection isometry in = lsom(IHI*) is given by a matrix of 0(f,4) with a 
4-dimensional eigenspace of eigenvalue 1, and a single eigenvalue equal to —1 whose 
corresponding eigenvector is space-like. It fixes a codimension f totally geodesic 
hyperplane of Mt^ given by the intersection of its -|-l-eigenspace with H''. The 
orthogonal complement of the fixed hyperplane is reflected across the hyperplane 
by the isometry. The reflection isometry is determined uniquely by the hyperplane 
and vice versa. 

Consider the interesting special case where F < 6*4 is a group generated by M 
reflections ri, r2, . . ., r^/ with corresponding hyperplanes Hi, H2, . . ., Hm, and 
the hyperplanes bound a convex (possibly infinite volume) region P of H'* known 
as a fundamental domain. Moreover, assume the dihedral angles of P are all tt/2. 
In this case the presentation of F takes the following nice form [H] : 



where for each pair 1 < i < j < M, mij is either 2 or infinity. As usual, the 
"relation" {rirj)°° = 1 indicates the product r^rj has infinite order. The product 
of reflections r^rj has order 2 when the hyperplanes Hi and Hj intersect at angle 
7r/2. This is best seen by thinking about the picture in the plane of the product of 
two reflections. Otherwise the product has infinite order, or — 00. (Here we 
are not allowing intersections at other angles.) 

We will be considering the representation variety Hom(F, G4) C K^^*^ for groups 
F of the above form. 

The following lemma shows that near the inclusion map in IIom(F, G4) any rep- 
resentation has the property that it maps the generators to refiection isometrics 



Lemma 2.3. Let A e G„ be a reflection isometry. Then A has an open neighbor- 
hood U C Gn such that if B G U and = Id, then B is a reflection isometry. 

Proof: Recall that any involution can be diagonalized over C such that the 
diagonal entries are all ±1. Recall also that a reflection must have exactly one 
eigenvalue equal to —1. We can define the open neighborhood U oi A to be all 
matrices in G„ having [n — 1) positive eigenvalues (not necessarily distinct) and 1 
negative eigenvalue. Then any matrix in U that is an involution will necessarily be 
a nontrivial isometry which fixes a hyperplane of codimension f , in other words, a 
refiection. □ 



r = (ri,r2, ...,rM | (nr^)' 




of G4. 



Corollary 2.4. There exists an open neighborhood U C Hom{T , G4) C M^SJi/ 
the inclusion map such that if p G U, then p(ri) is a reflection for all i. 
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The representation variety Hom(r, G4) sits naturally as (connected components 
of) a subvariety of M^^^^, but by exploiting the fact that locally all the generators 
are reflections, it is possible to reduce the dimension considerably. To a reflection 
isometry r with fixed hyperplane H we can associate the f-dimensional subspace of 
given by vectors Minkowski orthogonal to H. This subspace is simply the +f- 
eigenspace of the matrix corresponding to r, and it will consist of space- like vectors. 
In reverse, choosing a space-like vector n determines a codimension I hyperplane 
n H'', which in turn determines a reflection isometry. Letting S C M'^ denote 
the set of space-like vectors, this process defines a map 

with image equal to the set of M-tuples of reflection isometries. 

Moreover, the geometry of the fundamental domain P can be read from the 
normal vectors. Specifically, let ni and n2 be space-like in M^. Then let 

H, = {veM^ I iv,n,)^0}. 

U Hi n H2 n H'' 7^ and Hi and H2 intersect at angle 0, then 

("1,"2) 



= - cos (9) . 



In particular, we will consider only examples where is always 7r/2, in which case 
the above simplifies to 

(ni,n2) = 0. 

Choose a representation p S Hom(r, G4) sending each generator to a reflection. 
In the above manner, we replace every reflection matrix p(ri) by a corresponding 
normal vector Hi. We now have M Minkowski 5- vectors, instead of M 5 x 5 matrices. 
The relations of T written in terms of normal vectors all have the form: 

(jii ,nj) — when rriij — 2 (angle condition) 

Let U C IIom(r, G4) be the open neighborhood of the inclusion map of Corollary 
12.41 It is clear that, restricted to p,^^{U), fi is a submersion with fibers given by 

scaling the normal vectors n^. Given a vector v = (j^i^ tangent to the point 

(ni) € ii~^{p), p^,v € TpM.^^^'^ is an infinitesimal deformation of p if and only if v 
satisfies the following derivatives of the above angle conditions: 



— when — 2 



Any solution to this system of polynomials will now be a vector (n^) in M^*^ in- 
stead of M^SM^ js^Q^g ^j^g_^ 

we do not need to include the relation corresponding 
to each generator being an involution. This interpretation clearly has an immense 
computational advantage over working with the matrices directly. 

Finally, to show p is infinitesimally rigid in Hom(r, G4) it suffices to show that the 
subspace of vectors (nj C M^^^ satisfying the above equations has dimension equal 
to 10 -|- M, where 10 = dim(G4) dimensions come from infinitesimal conjugations 
by G4, and there are M dimensions corresponding to scaling the normal vectors, 
one for each generator of T. 
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3. The 120-cell 



Here we will outline some of the basic properties of the hyperbolic 120-cell. We 
will use the word face to indicate a 2-cell, and wall to indicate a 3-cell. The 120-cell 
is a regular convex polytope formed by 120 dodecahedral walls, where we define 
regular to mean that its symmetry group acts transitively on the set of flags. (A 
flag of the 120-cell is quadruple consisting of 1 point, 1 edge containing the point, 1 
pentagonal face containing the edge, and 1 dodecahedral wall containing the face.) 
The 120-cell has 600 vertices, and is dual to the 600-cell formed by 600 icosahedra. 

The 120-cell can be embedded into H"' in such a way that the resulting convex 
hyperbolic polytope is compact, regular, and all intersecting dodecahedra hit at 
right angles. The quickest way to describe this polytope is by giving a list of 120 
space-like vectors that are Minkowski-normal to the 120 walls. For completeness, 
we list the 120 normal vectors in M^, using the Golden ratio t — {1 + a/5)/2: [2] 

(1) The 8 vectors obtained by permuting the last 4 coordinates of (\/2t, ±2, 0, 0, O) . 



Consider the set C of walls of the 120-cell given by the 24 space- like vectors of items 
([1]) and ([2]) above. Interestingly, these 24 vectors determine 24 hyperplanes of H"* 
which bound a regular (hyperideal) hyperbolic 24-cell, which is a polytope with 24 
octahedral walls. This set C will play an important role here. One can compute 
directly that the walls of C are pairwise disjoint in H'*. Moreover, there does not 
exist a set of 25 pairwise disjoint walls of the 120 cell. 

Proposition 3.1. Let P he the hyperbolic 120-cell. A maximum set of pairwise 
disjoint walls of P has 24 elements. 

Proof: Suppose we remove 24 walls from the 120-cell. For each wall that we 
remove, we place a marker on any wall which was adjacent to the removed wall. 
Each wall of the 120-cell is adjacent to 12 other walls; therefore after removing 
24 walls we have placed 24 x 12 = 288 markers on the remaining 96 walls, or an 
average of 3 markers per wall that remains. The claim is that every remaining wall 
has exactly 3 markers. If this is indeed true, then removing an additional 25*'' wall 
would be impossible because any wall we removed would be adjacent to 3 of the 
walls in the original set of 24. 

Suppose one of the walls had only 2 markers. This implies that there is at least 
one other wall with 4 markers, implying that the intersection of a certain set of 
4 pairwise disjoint walls with this wall of 4 markers is a set of 4 pairwise disjoint 
pentagonal faces of a dodecahedron. This is impossible because the maximum 
number of pairwise disjoint faces of a dodecahedron is 3. Therefore no wall has 2 
or fewer markers implying every wall has 3. □ 

The above proof was explained to us by AUcock. 



We are now ready to discuss the main result. 

Theorem 4.1. Let P C be the hyperbolic regular right-angled 120-cell. Let 

C be the set of 24 pairwise disjoint walls of P given in Section Let T < G4 — 




4. The Main Theorem 
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Isom{M*) < 0(1,4) be the discrete infinite covolume group generated by the reflec- 
tions in the 96 walls of P that are not in C . Then the inclusion map T G4 is 
infinitesimally rigid in the representation variety Hom{T,G4). 

Before beginning the proof let us discuss the connection to Coniecture ll.il 

Proposition 4.2. Let F < G4 be the discrete group of Theorem \4-l\ Then T has 
Fuchsian ends and the quotient Cr/F is isometric to the 120-cell P. In particular, 
F is convex cocompact. 

Proof: Consider the collection of 24 dodecahedral walls C C and its orbit 
r C. Using the facts that all the dihedral angles of P are 7r/2, and all the walls of C 
are pairwise disjoint, it follows that any intersecting translates of C in the orbit F-C 
glue together smoothly. In particular, the entire orbit is a disjoint union of totally 
geodesic hyperplanes. Let Cr C M."^ be the F-invariant convex subset bounded by 
F-C. This shows that F has Fuchsian ends. It is clear that the quotient Cr/F is 
isometric to P. □ 

Combining Theorem 14.11 and Proposition 14.21 shows that Conjecture 11.11 is true 
for F, which we record here. 

Corollary 4.3. The discrete subgroup F < G4 has Fuchsian ends, is convex co- 
compact, and infinitesimally rigid, as predicted by Conjecture ] 1. 11 

Let us begin the proof of Theorem l4.1l We begin with 96 5 x 5 reflection matrices 
in G4 < 0(1, 4), the image of the generators of F under the inclusion map. We can 
replace each such reflection matrix with one of its (space-like) eigenvectors cor- 
responding to eigenvalue —1. (All the possible choices are colinear.) The complete 
list of 96 vectors Hi will be the 96 even permutations in the last 4 coordinates of 
(V2r, ±T, ±1, ±T~^, 0), where r is the Golden ratio. Pairs Hi and Hj corresponding 
to orthogonal walls of P will satsify the relation 

{Hi, Hj) = 0. 

Let W C T^M^^" be the linear space of infinitesimal deformations. Suppose we 
are given an infinitesimal deformation 

of the 96 space-like vectors which maps via fi^, to an infinitesimal deformation of F 
in G4. Then the following linear equation must hold for all pairs i,j corresponding 
to intersecting orthogonal walls of P: 

(jii, Hj^ -\- (jii, Hj^ = 0. 

Keep in mind that the 24 walls of C have been removed from P. There are 432 
equations of this type, corresponding to the 432 remaining faces of P. As described 
above, we wish to find the solution space W of this set of linear polynomials. To 
prove that F is infinitesimally rigid it suffices to show that the solution space has 
10 + 96 dimensions, where 10 comes from the action of G4 by conjugation, and 96 
comes from scaling each of the 96 space-like vectors Hi. These 96 scaling dimensions 
are killed by /x*. Indeed, by this count we see that the solution space W has at 
least 106 dimensions, so it remains to show that it has at most 106 dimensions. 
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Begin by enumerating {pi,P2, ■ ■ ■ ,^432} the polynomials defining W. Each pi is 
a polynomial in the variables {vi,V2, - ■ ■ , V480) where 

= (*^5(i-l)+li^^5(i-l)+2>1^5(i-l)+3)'f^5(i-l)+4>1'5i) • 

Then define the matrix Aaig of algebraic numbers 

(Aalg)ij := ^ {pi{vi,V2, V480)) ■ 

Each entry (Aaig)ij is a number because each polynomial pi is linear in the variables 
Vj . Aaig has 432 rows and 480 columns. The goal is to show its kernel has dimension 
at most 106. We will do this by showing the rank is at least 374. 

In order to ensure that Mathcmatica can correctly and efficiently run the com- 
putation, we replace every algebraic number entry of Aaig with a square matrix 
of rational numbers. The number field Q{a) contains every entry of Aaig when 

a = We choose the basis 

{1, a, a^, a^} 

for Q{a) as a vector space over Q. Then each entry of Aaig is replaced by a 4 x 4 
rational matrix representing its action by left multiplication on Q{a) with respect 
to this basis. For example, the number ^ (— 1 ^ Vs) is replaced by the 4x4 matrix 



( ' 





-2 


\ 











-2 


1 

2 





-1 





V 


1 
2 





-1 / 



Once we have the rational 4x4 matrix replacements for each entry of ^aig) it 
becomes a 432 x 480 matrix of 4 x 4 matrices. By ignoring the structure of the 
4x4 matrices, wc can think of it as a 1728 x 1920 matrix Aq of rational numbers. 
It is easy to see that the kernel of Aq has dimension at least 4 times that of A^ig. 
(If u is in the kernel of ^aig then {u, au, a^u, a^u} will be in the kernel of Aq and 
linearly independent over Q.) Therefore the rank of Aq is at most 4 times the rank 
of ^aig- To prove the infinitesimal rigidity of F, it therefore suffices to show that 
the rank of Aq is at least 4 • 374 = 1496. 

In order to further simplify the computation for Mathcmatica, miiltiply each row 
of Aq by the least common multiple of the denominators of the rational numbers 
in that row. This gives us the integer matrix Az with the same rank as Aq. With 
some effort on a powerful computer (in 2008), Mathcmatica was able to determine 
that the rank of this matrix is 1496, the desired result. Therefore A^\g has a kernel 
of dimension at most 106. This proves that the inclusion map of the discrete group 
F < is infinitesimally rigid in the representation variety IIom(r, G4). 

The rank calculation for A^ took approximately 8 hours, and several gigabytes 
of RAM. This is perhaps related to the well known computational difficulty that 
diagonalizing an integer matrix via the Euclidean algorithm can lead to intermediate 
matrix entries of enormous size. We can greatly decrease the calculation time by 
reducing Az modulo a suitable prime p, obtaining matrix Ap. When working in 
the finite field Fp the diagonalization process is nearly trivial, and rank(Ap) < 
rank(Az). Therefore, we simply reduce Az modulo several primes until we find one 
such that rank(Aj,) = 1496. Once we find such a prime we are done by the above 
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inequality. Using the prime 113, this method allows us to arrive at the correct 
answer of a rank of 1496 for A% with a calculation time of approximately 5 seconds. 

Acknowledgements: All computer calculations were performed in 2008 using Wol- 
fram's Mathematica 6.0.1.0 on a MacPro running 64-bit Linux. 
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